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The problea* solving aodela described in this paper 
vere selected because they offer uQntechnological alternatites to 
solving school district pr^leas, because they solicit and r4spfct 
the opinions of iiivolved vot^kers an^ clients, and because each aodel 
kas several variant foras that can be applied tQ aany different kinds 
of probleas. The three techniguea described are.fdrce field , analysis, 
which enables adainistratocs to visualise .and finalyse the eleaents of 
a problear the noainal gro^p technique, which provides a aeans of 
polling constituent preferences , and the Delphi forecasting aethod, 
ehich aakes the creation of^onsensus possible. Five /^exaaples of the 
application of the Delphi aethcd are priisented. (Atlthor) 
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The Educational Resources Information Center (ElfiC) is a national, 
information ly stem. operated by the National Institute of Education, 
ERIC serves the educational community by disseminating educational 
resoorch results and other resource inforriiation that can be used in 
developing more effective educational programs. \ ^ 

The ERIC Clearinghouse on Educational Management, one of several 
. clearinghouses in the system, was established at the University of Oregon 
in 1966. The Clearinghouse and its companion units process research 
reports an<} journal articles for arfnounccroent in ERIC's mdex and - 
abstract bulletins. 

Research reports are aVinounced in Resources in Education ^RIE), 
available in many libraries and by subscription for $42.70 a year fron^ 
th^ United States Goverpmei^t Printing Oii^^Washington, D.C, 20402. 
Most ot the document^ listed m R4E can be purchased through the 
E^IC Dement Reproduction Service, operated by Computer Micro- ' 
film International Corporation. 

Journal articles arc announced m Current Index to Journals iri Educa- 
tion, CIJE is' also available in mapy libraries and can be ordered for %6% 
a year fron* Macmillan Informiition, lOOD Brown Street, Riverside, 
New Jersey 08075. Semiannual cumulations can be ordered separately. 

Besides processing documents and jourffal articles, the Clearinghouse 
has mnq^er tnajor function-information artalysii and syntheiis. The 
.Clearinghouse prepares bibliographies, literature reviews,' state-of^the- 
knoSvledge papers^ andvOther inter|^retive research studies on topics in 
its educational area. <* 
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FOREWORD 



Both the Associati(^n of/Ilalifomia School .Administrators 
aAl the ERIC Clearinghouse on Educational Management are 
^ pleased id cooperate in producing the School Management 
' Digest y a series of reports designed to offer educational leaders 
■ essential information on a wide range of critical concerns in 
^ edueation. ^ ^ * ^ 

At a time when decisions in education must be made on 
' I the basis of increasingly complex information, the^t^cs* pro- 
'\ vides/school administrators with concise, readable analyses of 
\ the most important trends in* schools today, as well as points 
' ' \ up the practical impHcations of major research findings. 

By special cooperative arrangement, the series draw^ on 
^^thc extensive research facilities and expertise of the EflLIC 
* Clearinghouse on Educational Management. The titles in the 
' , ierics were planned and developed cooperatively by both 
organizations. Utilizing the resources of the ERIC network., 
ti^e Clearinghouse is responsible for researching the topics 
* ai\d preparing the copy for pul^lication by^ACjSA. 

\ The author of this report, Norn\an Hale, >vas comnf>is- 
sioped by. the Clearinghouse as a research anijyst and writer. 

Bert C. Corona ^ ^ Philip k. PieLe 

President • ^ ^ *v ^ * • , Director 

. ACSA ERIC/CEM 

ERIC \ • ^ f 



INTRODUCTION 



**Wcll Smith, wcjvc weighted the rcgrcafivc variable which 
gives us ^e coijrect initial figures^xTnen we matched the 
' coefHcients. Yo^ understand all tiys of course. . . ?" • 

What can Smitf^' do? doesn't completely understand 
t^^ computer printouts ia front of hiijn a district cabinet 
meeting. Should he jpress to have a poiht explained or should 
he pass? If Smith ^s! like the rest of us WJho often fe^ V'aguely 
uncomfortably^ in tqe presence of columh&^of printed figures, 
he will probably ^2Lsi. He will assume that 5(Jm^one else under- 
stands even if. /le ddes not. He allows his decision-making re- 
sponsibility in this case to pass into the hands of others. He 
has decided not to dpcide. 

How often is the/ above scene repeated? It is difficult to 
say, but certainly tnt situation is typical of a problem many 
school district persinnel face. The information^ explosion, 
technological advanc es, and the sheer complexity of the school 
district and its services have combined to create complicated 
management systems. Tools like PERT (Program Evaluation 
and Review T^chni<|ue) and PPBS (Program, Planning, Bud- 
geting Systems) are only two examples of districtwide tech- 
nological systems thit evolved in the sixties. Other computer- 
ized methodologies can be used for projecting enrollments, 
scheduling the use o ' facilities, writing student Schedules, and 
cpmputing.the costs of contracts; these are now conynonplace 
in large school dTstiicts. No wonder people like Sinith occa- 
sipnally get lost in tlie machineryi ^ 

One effect of su :h systems has been to requiofe that educa- 
tional planners anc decision»makers possess rnucK greater 
knowledge • and ex pertise than traditional/ management 
hiethods requtred. As Sanders notes, this "specialized know- 
^iVdgc and skill ... is not possessed by many of the adrtiinis- 
trator^ ^d leaders \^ho are truly responsible for policies and 
planning." Consequently, more decisions ar^ left to the "edu- 
cational technologist," who Jias acquired/ a greater role in 




• 1 



'8 



4 



lis AbilitN to crr^!c\con$cnsus- 




^decision-making. As more problcmi come- to be defmed in 
technological terms, people lilJip Smith \%iio are not^ informa- 
tion ^specialists may be edged out of the polio firoccsses. 
Either decisions nill be increasingly left to the techi^ologists 
^ or„Worse, proj^lcitis may simply be ignored^ 

, [\l%ile mviy of the problems of the §chool district are 
amenable to {echnological solutions, tnanv a/e ijot/ Questions y 
of creating ine%* programs, cancelling old ones, changing the . 

• curriojJum, implementing regulatibris; prgvidingVcominunity 
services, and locatiijg nev% facilities arc nonrecurrinW situations* 
that require oae-of-a-kin,d programs or decisions. They rt^quire 
a problem-soK-ing flexibility that technblogical sysi^ins do not 
' provide. 

W^here does the aii^inistrator turn ^^iien he or she heeds 
to make decisions in these arenas? » 

Unfominatelr, mu<h ^,^he hteratUre on problem ':^King 
and'decision-making u <\ither diffuse and mathenvyical or to^!^ 
abstract for practical usei Th«l theories ire nor often tranil|ted 
into easilv understandable a^d applicable fomiujas. Andpon- 
technological 5\ stems an^ e special! v difHcul/to formalize 

As an attempt to br>^5e the gap bct'^ctn a pure th^oik t>f 
decision-making aiid a iheorv of deasirn-makine as an irttui- 
^ ti>e, unstructured process, we offer three noijtcchnoloiical 
models from current e^ucauonai Inerature. The models Have 
'been 4!iv^n for spe^ifid 'reasons. First, :fce\ present curneni 
a]temati\ef toi^technbloAicai s\ sterna - T\ic\ are ine3q>ef>sj\ e : 
they reqiiire no equijpmcin: niorr so-phisiKated than af hind 
' calcuIatoL SecoTKi, ea|ch pnodel has se\era] \anani fc^mv^nd 
can be aAplied to r?:an\ piffereht^imds of problems. T^rd, 
each has been chosen because ir rtfiects'^ bel>ef that cpn- 
adtation And group cfifor: arc preferable :o indrvidoals actng 
"unilateraU\. . > 

« Most important of alj, each mc>de] has a specific strength. 
The value of foice-T)eid anaivsis :s its abililv to \isualize 2nd 
analvz^e the elements' of a 'problem. The nominal grcnip te:h- 
nique is a means of pc^Ui^g constnuen^, or client preferences 
concemi^ both prc*blemjs and soliiiJons. ThJ^ strer^gtj^ oT jthe 
Delphi forecasting model ^s its 



These nipdels should aid Smith and any others who are 
' faced.with the problem of evaluating a new'prpgram or ap old 
Qtie, working with^'a commurrity group, or deliberating -on 
new ptolicy/Used imaginatively, these models pTovide attrac- 
tive, simple alternatives to more complex procedures. Their 
,use will also encourage participation by more people in all 
. areas of district decision-making. < . . - 
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UNDERSTANDING A SITUATION: 
FORCE-FIELD ANALYSIS 



Force-field analysis is an especially useful technique in the 
early stages of problem-solving. It provides a graphic means 
for cither one person v^orking alone or many people v^orki'ng 
together to dissect a probTem into its major parts (forces.). 
According to force-field theory, every situation is ti\ a state 
of *'cJuasi-stAtionary equilibrium" as the resujt of a ''complex 
field of forces" that work in **vacying directions, at differing 
strengths. The existing situation, or status quo,* is the result 
of the combination of these forces." 

Sanders illustrates the theory pictorially in figure 1. Driv- 
ing forces are defined as "t^hose which tend to change the exist- 
ing level oj tend to help reach the desired level." Restraining 
forces are "those which tend to resist change «rr preserve the 
stat;us quo." 

AnValtertiative iljustration of the model is offered by Gas- 
Icell in figure 2. In this schema, thevertical liqe represents the 
status quo or the ''equilibrium" of forces in the situatipa. 

Force:fi9ld's view of any situation is a conglomeration of 
poised forces jfnakes itself especially useful in the analysis of 
problems. Before making any decision on a course of action,, 
decision-makers must Be able W enumerate the yaripqs forces, 
both driving and restraining. Seders notes^at this rigorous 
analysis -reveals that problems are composed of *'conTplex 
fields' of 'forces and myriad influences rather than single or 
isolated factors/' It helps the administrator to recognise that 
a^ingle hasty auction as,the result of a premature de6isioi\may 
have" no effect on the complex of forces. It may even have an 
undesirable effect. ' ^* 

The following hypothetical example, whi<^ appears in 
Gaskell, is only one of m^ny applications of the technique. In 
this situation, a teacher feels a hack of communication in the 
classroom. The teacher has A goal he defines as the "Open and 
Active Criticism of Ideas bptween Us." In an analysis of the 
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brivlng Forces 



FIGURE 1 . > ^ 

, , ' ^ . * Source. Sanders 




, situation, the teacher .draws a diagram afid lists .the forces 
* pressing, for open criticism and thosfe pushing'^against it (see * 
"tigurc^S). . Tbe^rces on the left, if allowed to become domi- 
nant, ^6uld push toward the go^ of open and active criticism 
between students ^d instructor. The forces on the right are 
•'those that inhibit- the attaining of the goal ^nd could result in 
the complete absence of criticism. Gask'ell reminds us that 
"diagr^sis is a continuous part of problem solving" and tl]at 
the force-field scheme may need to be redone several times to 
identify the basic .forces. ' 
• With the **identification of forces'' we have completed 
the first of what Sanders see^as the four steps in any kind of * 
**decision making, problem solving, change, or program p fan- 
ning." The second step^involves choosing an entry point or 
".unfreezing" the current situation (see figure 4).' A decision 
is made to strengthen a driving force or to weaken a restrain- " 
ing force in order to move the program in the desired direction. 
Sanders disagrees with many of the authorities in Change 
strategy^ Avho **suggest that a strong unsettlifi^ experience is 
necessary to destroy the equilibrium nf the status quo," San- 
ders believes it" h preferable to weaken a restraining force, 
^ thereby avoid ing'^severeT^.eact ion and disruption. 

Step three involves/*moving to the new^evel/' This move- 
rhent is the jesult of a planned combination of strengthening • 
* . and weakening forced. When the program reaches its new level', 
it undergoes **refree2ing," the four-th -step, which r^qi^ires 
"planned and organizecl evaluation and Tftonitc^ingof the new ' 
process." This monitoring assures that inertia- will not drag 
. thfe program back to its old level, 

GaskeB rcfor^jmends that the compilers of the field analy- ^ 
sis rate the driving forces on a simple numerical sc2l\^ in terms 
"of their importance and their cmc ot difficulty of^hange. 
Siich a ranking system inigbt be of help when making a deci- 
sion about the entry point, 

Force-field's great advantage is it^ Simplicity. The tech- 
* nique can be learned in Jt single sitting. *Ye^, as simpje as the 

« procedure is, it nonetheless provid^p an alternative to hlher 

' "oversimplified systems which ^ee only a single rause and 
' ' ' ' ' , ' * . 
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effect.", S^^]UCl€«^also/j^^ out that it Ccln be used in ccihjunc- 
tion with statistics to **any degree of sophistication whicl;;^ 
may be considered desirable." ^ 

Force-field andysis seems particularly useful for current 
programs that |k faltering. Programs for minority studerfts, 
governnient-manfeted programs, community service pro^- 
grams, vocational programs, and plans for curriculum evalua- ^ 
tion and change seem ideally suited to this kind of approach. 
Unfortunately, making the force-field work isViot as^easy as 
^andcr^ makes it sound. The model offers no practical advice 
on choosing a point ^of entry, which is, after all, at the heart 
of decision-making. It presents little or no^advict or help for 
starting new programs. And it proposes fvo readily useful mea, 
for reaching consensus ^n the directior^^jf desire (faction , 
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FINDINGSOLUTrONS: 

THE NOMINAL GROUP-TECHNIQUE 



Where dosolutions to problems come from? Unfortunately 
force-field analysis does not answer that questioi;^. It prescribes 
no theory or practice for gathering input on possible solutions 
to a problem. /What administrators need, besides an easy 
method for analyzing problems, is a technique for generating 
alternating solutions to them. ^ 

An Alterhative to Interacting Groups 

Recent trends in educational management stress the im- 
portance of involving management persontiel in the decision- 
making process. The m^agfmcnt tean), which operafeson the 
theory that persons who ar^ affected by'decisions shouldiielp 
make them, is only one innovation making Use of thi^eory.^ 
The nominal group technique is another. * * 

^he nominal group is the antithesis of the traditional inter- 
acting group or Ideas session-sometimes known as "brain- 
storming"-which is often cited as a model of democratic pro- 
cedure. Brainstorming is characterized by an open exchange 
among group members An which everyone is encouraged to 
participate fr(^. But Van de Ven and Delbecq contend that 
interacting groups often get stuck on a single topic and merely 
elaborate on it. Interacting groups reach for decisioY»s before 
problems are fully aired and are more geared to problem dis- 
posal than problem underst^ndmg. They also have a regret- 
' table tendency to reinforce certain human weaknesses:. people 
ire more comfortable responding to ideas already pxop6sed 
,than they are coming up with new ideas. Verbally proficient 
; members dominate the interacting group. Divergent opinions 
f are often ignorc^d. 

To combat theSe weaknesses, Delbecq and Van de Ven 
^have created a group in which ^^individuals work iri the pre^- 
,^nce of each othpr but do not interact." ' ' 
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Instead, ei ich individual ii writing ideas on a pad df paper in 
front of him. At the end of 10 to 20 minutes, i^very struc- * 
tured shaiinff of ideas takes place. Each individual in round- 
robin fash io^ provides one idea from hi^)rivatc tist which ; . 
is writtch oa a flip-chart by a recorder in full view of other 
members. There is still no discussion, only the recording of 
privately generated ideas. This round-robin listing continues 
until eactt member indicates that he has no further ideas to 
share. THc output of this 'nominal process is the tptal set 
' created tfy tffis structured process. " 
Only after all aspects of the problem are explored does the 
process of ranking the ideas in order,of their imp'brtance begin. 

"How effective the nominal group? Van dc Ven amd Del- 
htcq cite studies showing that^ in terms of the **mean number 
of ideas,"/'the meaq total number of ideas* produced," and 
the 'Equality of ideas produced," the nominal grpups were 
foUnd.to bc'"signif icantly superior to brainstorming \n generat- 
ing information' relevant to a problem." 

Thcr^ are many reasons for this superiority. Because it 
avoids (iominance by one individual, the procedure encourages 
the expressic^n of divergent and incompatible -ideas. It "stimu-' 
lales creative tension by means pf the presence o^ others, the 
silence, and the evidence of activity." It indices a «ensetof 
responsibility, in all the members and encourages the expres- 
sion of minority ideas. Such an organization of activity c^ses 
the grpilp to "perceive the taA with an attitude of *p*roblem- 
niindcdncss'as o)pposcd'to 'solution-mindednes's'." , r 

TheTiominal group can bes,ascd not -only to identify prok^^ 
]cms but to provide solutions as well. In the first round, mem- 
bers are asked to concentrate only on* identi^fying the prol^- 
icms at haa^. Oi(ce the major pjobl^ms are cited, membci-s 
arc asked to concentrat«/6n Solutions. V^m de Ven ^d Delbecq 
suggest 4h4t the two 'different aspects might be approached 
either in diff^fent sessions or by different groups. ' 

A 

• .the, f^Qjmmal Group as lan Intervention Technique 

,.Mosley:and Green report success in applying nominal 
group prbciAlurcs in all areas of problem diagnosis, planning, 
Shievaluatiori artd in situ^ipns asd^vCTse is business organiza- 



tions, churches,^ aixfl < university. The members of tKe organi- • 
' • zation constitute tik membership of the nc^inal group. Em- 

• « ployecs work together to identify the organization's- problems 

and to suggest iltuticins. ' ,x 

^ ' For.inlerventioni oFtliis sort, Mosley and Green recom- , 
'mend a different prc|blem-identification*procedufe. They sug- M 
gest.rhat the partici](Dants Ijst the org4|iization*s strengths be- , ^ 
fore they list problems: -"Chai^ging. this one-sided, negative 
focils into a tWo-dimensional pexSpective >Mhich^hcludes or- 
ganizational strengths often has a dramatic^ polit(ye effect ojv 
the general receptiveness of the entir-e OD' (oi'gani^ational 
• developrment) effort, most of which Still lies in the fAitur^.** 

* They also recommend that when intervention tA'a hierarchi- • 
cal structure becqrrtis necessary, pe^sops of sirnilar^rahk shoui^cj-^ 

' . be^ouped together to prevei^t a potential influen'cing»pf ,sob- ' ' 
orflin^tes. ' > , ^ ' '* ~ C * 

Anoffier, quite different, ^plicatiajp^pf the nbmiT\^*group , .J 
is ^ited by Zastrou^. He used tht te.chriiqye to^polj a: uniterwty . 
social* wprk , class to discover student pil?ferences for coj^rse ^ / 
' content.^^y me^ns o^ the technique, Zastro^y r^port^ that 4w ^'x. 
^ was able to understand the stadeut^* interests and was Better 
able to serve those interests.*: ' ^ . * . .- . 

Planrring fslew Programs \./ - '* • 

Because of its ability, ta'geherate problem descriptions /" 
from a client population/ the nominal groyp,^Lcchniqiie is^ * 
especially suited to the ^arly* stages of .program 'pUrtning. tt : ^ 
is especially useful in cases wh(:re a.*'vadety of^jgrqyps, frag- * * 
mented in terms of vested inrcresfs, rhelgrical and ideological- 
concepts, and differential ejcpectise>' netd To bp brdttght to- 
gethpf for a program to emerge oc for cij'ange-to take 'place'' 
(Delbecq and Van de.Ven). " ^ . . • [ j' 

This destription would sceiri t(> apply tp commartit^S»r-|,^ 
vice prograft)^ in the public schooh or any ser\ice* progtarh » ' 
designed for the benefif cJi^n^ of tTie'School district. These ^ 
might include programs desyjned'to reach. dis^^v^fUaged st'u- ^' 
-dents (special skills pr<igrams for mihoYity pr handicapjled stu- 
dents),- programs to irnplement basing, vocational guidi^nce^ . \ 

" ' ^ ' ' " ^- \\ ' : ^ - ' 
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progcams, and counseling and*tfesting programs/ Within the 
district itself, the technique can benlsed to gather information 
and ideas about* curricular change, -policy changes^ and pro- 
• gram implementation. ^ ' # 

Dclbccq and de Ven have written a Program Planning 
^ Model (PPNI) that makes use of- these nominal group tech- 
niques. The first step of PPM is callbd the problem exploraUon' ' 
pHase. A target group of*participants is identified in terms of 
their involvement eitjier as potential clients of th^ nev^ pro- 
. gram or as people responsible for implementing it. Which indi- 
, Viduals are included in this group depends oTi the de^ee to 

' which the program will affect them. Once this group 15 
assembled, members are asked to identify problems this new 
programinust solve, ' v * 

Delbecq and Van d^Ven hav^e discovered that the enUmera- ' 
ting orproblems often involves a fevela'tion of personal de- 
tails. Forexample, a program being^set up to helb handicapped 
stutfe^ts will probably require the sharing of cflSnsiderab'le per- ' 
. > ^sonal informatioji by'the handicapped members of the nomi- 
nal group. The authors feel that the nominal technique pro- 
'vides a way for the participants to gradually volunteer theje 
"personal dimensions a Hftle at a time." ^ 

The actual machinery for running the' group will vary franl 
case to case. I n^large groups, V^roman- recommends that satel- * 
lite groups of fr'^mten to fifteen members Jbe us^. The dis- , 
, play of written materials will also depend, on thei number of 
\ participants involved. Some commentators recomYncnd list- 

ing ^1 materials on a large board in front of an assembled 
group. Qften a'^reak in the proceedings' will be necessary to' 
compile and display the^l^t of problem^. Some groups will 
choose to vote-on and display only the most significant prob- 
' • Ifcms uncovered. In some cases it may be more advantageous 
, ^ to display c/Ajdeas to the group. ^ 

Knowledge exploration, the second phase of the model. , 
brings togeHter a selected gr(^p of clients from* phase one 
and a group oA resource experts. This new group is presented 

* with the list of problems resulting frorfi the first mating. Using 

: — nominal group technique again,, this group responds to two 

* * ^ * 
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questions: "What existing resources ckn be used to solve these 
problems?" and "What new resoujces will have tobe createci 
to solve these problems?" Responclents list their answers, 
which are again collected and displayed /ound-robin fashion. 
From these answers, a list of existing resources and a list of 
new resources will be developed.. 

The final phases of the program do not utilize nominal 
group procedures. The actual v/riting of the program descrip- 
tion muA be accomplished by technicians who m'atch needs 
with resources. However^ the very last ptfase of the program 
involves reporting back toii^^participants in , phase one^an 
explanation of the final contenfcl the program. 

' Thorough informatfon gathering amd analysis are impor-, 
tant parts of decision-making. The nominal group techrij/que 
presents an easy, convenieprf method of gathering informa- 
tion and ideas on a variety j of topics'from the clients or con- 
stituents of art institution. 



O ' 14 

ERLC 



21 



ACHIEVING CONSENSUS: 
THE DELPHI MODEL 



A decision is a collective agreebnent on a single coQrse of 
actjon.Jt represents the best response to a current st^ate of 
affairs and, presumably, it represent^ a consensus. A large part 
of decision-making actually the Attempt to find common 
ground, to reacKa decision all parties can live 'with. The nomi- 
nal groqp technique recognizes the importance of achieving, 
consensus when it includes affected parties in the process of 
program planning. ^ • 

Although decisions deal with current situaiJ&ns, all deci- 
sions face in two directions. They remedy past problems and 
attempX to anticipate future ones. Thornton and colleagues 
pjedict **it is inevitable that more of the future of education" 
will be taken into account by educational managers. Increas- 
ingly, Hecision niaking in the public schools must look toward 
the future. 

. Hov^ d<^ we achieve consensus in the decision-making pro- 
cess? And hfaw do we plan for the future? Fof many program 
administrators^ the answer to both questions is the Delphi 
model. . 1 

^ * 

History and Assumptions of Delphi 

^ As Dalkey and Helmer report, Delphi was originally con- 
. ceived by the Rand Corporation as a method of obtaining "the 
most reliable consensus ot opinion of a group of experts." The 
general procedure? for the Delphi forecast is quite simple. A 
number 6f experts'on the subject under examination dire se- 
lected. They agree to respond to a seWes of questionnaires to 
be mailed to them. On the first questionnaire, the experts 
answer questions and make predictions about the matter under 
study. The questionnaires are returned by mail, the results 
are colla^ed, and a second questionnaire is retuAi«d to each 
participant. - . 

On this second questionnaire, some means of reporting 
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the Igioup conscrijsus employed. The individual's scbre is 
also r(r|)ortcd. Each participant vvhose' answer lies outside the 
grou 3 consensus (usually defined by a modal or median $core) 
is asked to recdtis dtr his'or her original prediction. Any re- 
Uponldent who wisies t<fe remain outside the group consensus, 
is asloed to justify that position. A third round of que$tion- 
nairey reports the new consensus and may also include ja mi- 
nority report of tlije general reasons participants chose td stay 
oUi^tside the consehsus. The original Delphi consisted of five 
roUnt|ls. \ 

Land researchers dis<;overed that this ''controlled opijiion 
feedback" was successfiu^n shaping group consensus toWard 
a final ^swer. It was^^tremely successful in answering 
alm^ic-like (questions and producing consensus predictions 
aboi^t fliture technologies. The fifst Delphi attempted to gather ^ 
opii|ion\ahoyt the ampunt oT nuclear firepower that woiild 
have to be mecte i at United States industrial targets to reduce 
muj^itions output by a, certain amount. Since then, Delpfeis 
hav^ been used to predict ener^ demands, growth trends, and 
the^ej|lction of ijesourccsl Not surprisingly, when social ^ien- 
tist^ slP^.thc sucqcss of Ij)elp^i they were att^rapted by both ii^s 
conjsensus-^odu(j:ing powers and its future-predictingqualitieS^, 
They wanted to ijise it ir^ their own research. \ 
But as Weaver (1971) p()ints out, the kinds of question^ 
Delphi wa^ most mceessful inlahsweringhad objective, "know-\ 
able" technological factors tolthem. The social'sciences do noi\ 
yet include svipfi factors. It canytot be determined, for example, \ 
when "aliemdioinl and impersonality of urban living will reacji \ 
its maximum/' jiH fact, says Weaver, we do not even know 
"what it rrieansjto speak of a nfiaximum in this case.!' Because 
the data base for Ifhe social scijdnces is so much le&s developed 
th^in il is for thje Hard sciences!, land because of differing inter- 
pifctations of scjcial mdicators, ^elphi forecasts h^ve been less 
successful when de^aling with so(tial issues. Weaver 1( 1972) con- 
-sclupc^ that thtrj^ ar^ too many vi^Tiahles of a personal and sub- 
' (jivje natur< to permit accurate predicting of social futures 
by: Wperts. Delphi, lin its pure f(Wm» is not appropriate in the 
?<^ciaj[V:iences a prediction device. 
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* ^ the f^ew Forms of Delphi 

/ Although the Delphi cannot be useci to predict the "liKeli- 
hood" of a certaii> future, Weaver believed we can use the Del- 
phi to talk in terms of what the future "cairbe made to be." 
It can be used to help define and creatr a consensus about 
* social and institutional goals. When used ig this way to project 
a set of values and goals, Delphi is an important tool in futures 
planning* 

The traditional -forecasting Delphi has given way in educa- 
tion, to the "normative" Delphi where the goal is to probe 
values and preferences jather than future events. Weatherman 
and Swenson analyze two forms of Delphi that have the great- 
est applicability in school districts: the "strategy probe" and^ 
the "preference probe." The strategy probe might Be fmployed 
by a scK!aol district that' has mandated' a new program and 
wants to poll opinion on the choice of a strategy to imple- 
ment it. The first questionnaire might be open-ended and 
simply ask respondents to suggest alternatives. Subsequent 
questionnaires would ask respondents to narrow their choices 

^and compare the alternatives in terms of cost, ease of imple- 
iftentation, and st) forth. -In consecutive rouAds, a consensu! 
toward a single strategy will emerge. If the respondents them- 
selyto are the persons responsible for implementing the pro- 
gram,- ^he move toward cdnsensus will further guarantee th^ 
program's success. f 
The preference probe (called a "focus" Delphi by Sandow) 

^ is used in cases when, a school district w^ts to poll its clients 
pr constituents abouf its priorities. This probe reveals essen- 
tial information ahout the participants themselves and their 
preferences, which the districftakes into account when setting 
its goals. 

Both these probes differ significantly from traditional 
Delphis in tliat they do not depend on expert opinion. When 
comparing two studies, Welty discovered that in the area of 
values forecasting laymen and experts produced roughly the 

1, thenTespecially in the area of 



same results. There is no need, 
values forecasting, for a selected panel. 
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Five Sample Applications 

Pclphi has many variations. The following applications 
exemplify' some of the situations to which the method has 
been applied. 

Media Technology SfjrVey 

Spitzer reports the use of a traditional Delphi to predict 
**trends in the future of educational media and technology 
which . . . might be the most significant in the period culminat- 
ing in the year 2000." Two hundred potential respondents, 
chosen from ^ professional directory, 'were contacted and 
asked to "ndnlinate" what they thought were importaift 
trends. Half of this group responded to the open-ended ques- 
tionnaire, and sixty-eight trends were recorded. 

These trends were listed in the second questionnaire and 
returned to the .respondents, who were asked to rank, them 
on a one-to-five scale in terms of their **importancc,".**their 
predicted incre^ise," -and the **certainty of prediction." (The 
last category, **certainty of prediction," was an attempt to 
hav^ each person rank his or htr expertise in the field; it was 
delete<iaftcr the second round.) In subsequent rounds respond- 
ehts received information about the consensus of the group 
and were asked to reconsider their answers. In all, four rounds 
were conducted. * 

Spitzer acknowledges that the results of the survey are 
difficult to interpret because they contain a **number of ambi- 
guities and methodolopcal problems which r^ced further in- 
vestigation." Some of the methodological difficulties con- 
cerned the reporting of the data. Spitzer's datk include four < 
pieces of information for each trend in the second, third, and 
^fourth rounds. However, the data for the third and fourth 
rounds are not rtadily comparable to tljat for the fjrst and 
second rounds because of the deleted item. The data are ar- 
• ranged primarily to demonstrate the consensus convergcijce 
phenomenon and therefore in i\\e manner least advantageous; 
to rating the trends themselves. Because a Delphi consists of 
statistical information, results must be displayed in a clcarj 
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straightfofWar4 format.* , • 

There is a philosophical problem with the survey as well. 
^ ^ It' seems to be the uneasy combination of preference probing 
and expert opinion that Weaver warns against. When rtfspond- 
, cnts were asked to estimate the **importance" of a ^end^did 
thejy understand that to mean its importance or value to 
V thc'm? Or did they understand it to mean the impact of the 
trend on educatic«i? Unless this distinction is made clear, 
the Delphi will be measuring two completely different phe- 
nomena* 

Although the survey was^unable to make any final ranking ^ 
of the importance of certain media trends, it does clearly 
demonstrate the process of producing consensus. - 

School of Educatiop, University of Virginia 

Before beginning their D^phi* preference probe, Cyphert 
and Gant hypothesized that perhaps one '**reason why schools 
of education have not recieved the support they desire on 
either a moral or a fiscal level is that they have not accurately 
assessed thd judgments^made a^out them by others." So they 
decided to use a Delphi probe to gather publjt^opinions about 
goals for the School of Education at the l^niversity of Virginia. 

Researchers selected 4^00 initial respondents from several , 
tategories: students and members of the School of Education, 
statewide educators, members of parent-tether organizations, 
members of the state board of ecjucation^Tewspaper editors, 
politicians, and persons from civic groups, with educational 
interests. 

Questionnaire I asked these people to ^suggest prime tar- 
"gets on which the»5ch6ol of Education should concentrate its 
energies and resources in the next decade." Questionnaire II 
- presented sixty-one generic items with JpHve^point grid for 
rating the priority' of each item.^^Juir^Uonnaire III reported 
both the group consensus and the jridividual's response for • 
each item. Respondents were asked to rate the items again. 
*^For all items where the participant wished to remain outside 
the consensus^, he was asked to state his primary reasons for 
so doing." 
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Questipnnaire IV contained the modal score for each 
item, the resp^dent's prior rating, and a summary of the 
major dissent|h^ opinions for each item. Respondents were 
.asked to consider the opinions and ma?e ^ final rating. The 
xesulfe of the final questionnaire yielded not only a list of the 
important targets but also the amount of public agreement 
on each one. From the probe the*SchooPof Education at least 
learned what the public feels its goals ought to'be. 

Cyphert and Gant report that **virtMally ail (99%) of tfie 
respondents' changes in opinion occurred on Questionnaire 
in, which informed them of the first 'consensus' reached by 
the group." They question the need for more than three rounds 
of questionnaires. . ' , - ' 

The DelQhos Branch Campus ^ 
The faculty of a university was divided on the issue of 
establishing a branch in another city. Administrators decided' 
to do a Delphi pfol^e to find .where the disagreements were 

• and* to build consensus for a set of goala, Judd remarks that 
thiV survey i« unique ia that **the experts responding to the 
questionnaire s^t were\exclusively part of the microcosm 
under study." 

,Thc first round of the questionnaire was a blank shdet of 
paper (fri^hich faculty .were^.^sked to list their statements of 
goals. for the new branch. A second questionnaire supplied a 
list of goal statements, which respondents were asked to rank 
in order'of desirability. The third questionnaire listtd each 
statement, its rank, and the amount of consensus generat^ 
in tfre second FQund. Faculty members w^re asked to return 
this questionnaire only if they strongly disagreed with some 
ramkings. V / 

Since this studyc^preserits little or no numerical data, it is 

* not as Complex as most Delphis. The wisdom of making roun4 
three optional \s questionable; it was the only round in which 
dissent Was registered. Treating^issent as an option in which 
thc^ dissenter must take the initiative to register his or her 

*^iOugWs may have- the effect of discouraging dissent. Under 
thii circumstance, consensus is created partially by default. 



.4 

To be ^id^ a survey should require all Respondents t8 repfy 
in any 'rOond for their opirtions to be considered. 

Judd reports that the final rankings were important not 
*only for setting policy goals of the new campus, but also be- 
cause the questionnaire process was itself an important tool * 
for gaining the support oT persons^ originally, opposed to the 
project. / , 

EHenstown, Washington, Public Scjiools 

As the public schools rjeach out into the <:ommlhuty to 
serv^ its needs, more ways need to be found XQ poll the cdm: 
munity about, its attitudes akd to acquire its support. Rasp 
rq^orts a use of Delphi to serve those cF^ds. Similar in some* 
ways to Cyphert and Gant's Delphi at University ofVir- 
^,^*|^ia, this survey in a public school district collected ^'data 
.^6m»which goals for building better pro-ams could be de- 
veloped.?* This four-phaSc Delphi was mailed to a sample of 
'iocal ^videntSfi^aff, parefits, citizens, and teacher trainers 
fr<>m tlie state poUeges and universities." 

The first questionnaire was fairly open-fended. When re- 
cdrding their opini^>ns,* respondents w^ere asked tp think in 
terms of the period from L975 to 1985: 

As a result of the experienc^es provided by th^ 
EUenstown School District, students should: • ^ 

♦ * Know , . 

Be Able to ^: 



EUenstown School District should: 
' Increase * 'x ^ 



Maintain ^ 
^Reduce 
l)evelop 



From these fh-st-round questionnaires, a second question- 
naire was 4cveloped. th^t corrtained a list of statements. Re- 
spondents wercj asked to circle numbers on a one-to-seyen 
scale. Here ai^two sample itenvs* 
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As result of the iipiperiences provided by the 
Ellenstcyir^irSchool District, each student should; 

high 

5 6 7 ' View coimpetition jn 
alUthings as healthy. 

1234567 Be able to read and un- 

derstand a newspaper. 

A thi^c^^ound questionnaire was mailed only to those who 
responded to the second questionnaire. In the third round, 
the modal answer (the answer cited most frequently)' was indi- 
CatcH by a square. The individual's response was indicated by 
a circle. Respondents were asked to study each item. If the 
mode for the item did not represent their thinking atihat 
moment, they were requested to state their reasons in a space^ 
following the item. The third questionnaire had this form: 

As a result of the experiences provided by^'tHc^ , 
EUenstown School District, each studefft jshould: 

low liigh 

l[2]34(5)6 7 ^ View competition in 

all things as healthy. 

1 2 3 4 ©[e] 7 Be able to read and un- 

> derstand a newspaper. 



The fourth^ roi;ind recalculated the consensus Trom the 
third round antf also included a minority disSCB^ting report for 
each item. The respondent was asked to consider this infor- 

^ mation as well as the group consensus and to make a final 
judgment. Rasped his colleagues decided, iij retrospect,. that 
the fourthi round was not necessary. 

The results of this survey, conclude* Rasp, provided Ellens- 
^town's superintendent ♦and staff with valuable information 

. from citizens about comitninity yalues and school priorities. 
Even in the face of certain limitations, ''Delphi does have 
strength and utility. It collects and organizes judgments in a 
sys^matic fashion. It gains input. It establishes priorities. It 
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builds consensus. It organize&^dissent. In short, it cannot be 
overlooked as a usefuUand reliable decision-making tool." 

Dallas-Fort Worth SWEF Survey ^ ' 

The Skyljne Wide Educational Plin (SWEP) instituted by 
the Dallas and Fort Worth Independent School districts is a 
^uch larger, more ^H^itious attempt to survdy community 
values for' the school district than we have thu^ far'encoun- 
tered. Bums reports that the procedures fa^ry slightly from 
traditional Delphis in that <^ly two questit)nnaire rounds were 
used. Also, the.number of participa]:its (over 900 persons in- 
vited to resp*ond) was quite large in this case. The attrition 
rate for the two questionnaires was 75, percent; that is, nearly 
700 people either did- not respond at all o^ dropped out after 
the first round. Considerf!fg the attrition rate, the decision to 
have only twf) rounds may have been wise. 
' * Unlike the Ellenstown Delphi, the firs^t SWEP question- 
naire was not open-ended, k consisted of 105 goal statements 
in the general categories of **basic skills, cifizenship, ethics, 
aesthetics,^reers, health and recreation, and life manage- 
ment," In 'addition, the questionnaire included twenty-nine 
»;*pfocess goals statements." For each i\en), respondents were 
aAed to answer in two ways. A, simple yes-no answer was re-., 
quested to see if the respondent felt that the item represented 
a **dore'' skill that **all students should have before comple- 
dKn of their progr^of studies." A five-point Likert scale 
was also used so that the respondent could assign a priority, 
to each item. Or the second questionnaire, space was allowed 
for the expression of minority opinions. 

Perhaps an even greater diffecejice between this and earlier 
surveys is the use of a computer to analyze and display the 
data. The districts h^Ve not only analyzed the answers to find 
the degree of consensus for each item, but rfkve also analyzed 
the data in terms of **age, sex, patron, ethnicity, occupation, 
and residence." The use of the computer certainly makes it 
p^sible to manipulate the^data in more ways for more pur- 
poses. Used this 'way, a Delphi probe can be an extremely 
computed procedure. If the/e is" some up p^^ imit to Delphi 
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• complexity, tHc SWEP survey prc^iy apj>roachcs it. An attri- 
tioriTatc o^75 percent is very high. Because of concern for 
the reliability of the final sample, it would be interesting to 
know who dropped out and why they did. 

Other Uses 

Sirois cites the use c^a Delphi model for measuring per- 
formance. This modcj.cstablishes criteria for "arriving at judg- 
ments regarding the remedial needs of local school districts." 
Thfc Delphi is used.to establish consensus about what makes a 
good program, and it creates a set of criteria against which to 
measure local performance. ^ 

Skutsch 'and Hall suggest tliat Delphi can be used in alls 
, areas of "facilities, services and curriculum planning," In the 
area of facilities, Delphi can be used^to project enrollment 
and the use of f^acilities and tp determine where new faciHtics 
should be located and how new facilities can be designed for 
maximum use. Delphi can help find answers to questions of 
student and community^ services. Questions concerning clcc- 
tivcs, required subjects, and vocationaUand remedial training 
can, to some extent, all be answered by the Delphi model. 

The Escondido Union Elementary School District, Cali- 
fornia, has used Delphi to resolve a number of diverse manage- 
. m'ent and. operational problems. The district has used the 
technique to reorganize its administrative services, evaluate 
principals' and central office administrators, establish differ- 
entiated staffing patterns at various schools, implement a 
year-round school program, establish a multimedia centej in • 
an elejnentary school and a junior*high school, resolve priori- 
ties for budget expenditures, determine personnel staffing 
needs and priorities and identify needs for clerical and cus- 
todial services arid for equipment and supplies for individual 
schools. . 

Some Precautions 
Some advantages of Delphi sl]ould be obvious frooi these 
examples", Skutsch and Hall cite Delphi's applicability in situa- 
ftions wh^ the following factors are present or desired: 
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1. A variable nnniber of people with v2(ned skills and status ' 
- are to be inchidedl * . •** 

2. Democracy, m, jvhich each person contributes to thjc best 
of his ability,- and has an equal vote, is the standarid. r 

3. ^o prior training or>**teain-buiIding" is-feasible-todevelop 4 
good working relationships. , ' ' ' , 

4. A variable number of questions or issue* are to be posed. 

As successful as Delphi may be in these-kin3s of situa^ 
tions, some precautions for the would-be designer of a prjobe 
arc offered by almost every writer on the subject/ Early in the 
design 'Stage, a decision must be rtade about a method of re- 
porting results. Although some Delphis supply verbaj rather 
than miDierical data (see Strauss and, Zeigler, for exarrtple), 
most, rely on a mathematical measure of consensu^. 

Of the mathcmaticaLprobes mentioned*above,nhe SWEP 
^up^cy and the Media iSirvey report thdr results»in terms of 
the mean (the ayerage of all responses). The University of 
Virginia and the Ellenstown schools' Delphis both report their 
results in terms of the mode (tlje response most frequently 
chosen). Of all the studies mentioned^here, only Cyphert and 
Gant give any space, to reason* for chooSing-one technique 
over another. They reject the mean because **few of the re- 
^onse scales used in a Delphi instruq;ient assurpe equal inter- 
vals," The mode is generally favored "in efforts to gSiin opin- 
ions ibout desired fut-ure conditions/^ while the media 
number midway between two.extremf s) is **often used in sur- 
vcyi fo/:u$ing on judgments about-ilme or* quantity 

Another factor in a DelpKi survey is time. Questionnaire 
results must be read £tnd ^ifalyzcd, and the new questionnaire 
cQmpilfcd and mailed oUt quickly. Lon^elayjs between rounds 
must bfc minimn^ad if respondents are .to be kept interested, 
Skutsch and Hall Estimate t^at thtee rouhds of a mail-Ou^ 
Pclphi with thirty respondents would require iibout 142 hoi^rs 
of wbrk and two months for completion of the project. More 
complex projects would -require correspondingly fnore tipne^ 

A more significant problem concerns the need for objec* 
tiyuy in composing the-c|uestionnaire materials. I^asp notes 
that "almost every study on the Delphi has testified to an tin- 
easiness regarding the development ojf tht second question* 
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iairc." folk and o|hcr writcjrs point out that tbe translation 
of raw verbal data into a goal statement or any kind of sup- 
posedly objective item is a difficult task. WcaveH 19^72) warns • 
that the content is subject to the biases of the c^pilers. Even 
tl|^^ choice of "alternative response fortns is* subjective." 

The Consensus Phen0nr«non 

^ The" greatest philosophical controversy over Delp^ has to 
do||with the ^oi>sensus phenomenon itself. What causes it? 
Weaver (1971) says' the Delphi process assumes that the ex^-' 
pcrt^or re^ondents will make logical; reasoned con<Jusions. 
But, he 'mamfains^ people may in fact change towfl^ consen-f 
sus for social or psychological reasons. 

Cyphert and Gant'S' study even provides some evidence 
thaf the Pelplii can be Qsed to tnanipulate participant response. 
They inserted a bog^s itcBn in their questibnnairc results and 
reported that k had achieved a high degree of consensus. Sub- 
sequent responses shqwed that participants tended to rate it 
higher when informed that its consensus was high. Weather- 
man and Swenson, along with many others, warn that this 
'convergence pjjenomenon needs to be studied more closely. 
Paradoxically perhaps, the Delphi cinnot give reasons why 
j)eople prefer one idea over another. It only explstins, in the 
minority report, why consensus does not occur. 

Some critics warn that the" Delphi is a conservative, 
establishment-oriented iiistrumehtVVcatherman and Swenson 
point out that * 

. divergent thinkcr», wHd may be undcr-rcprofcntcd on a 
Delphi panel, may prove to be the best forecasters, Strfh 
person^ mij^t find it especially difficult to atquietfce or bc ^ 
committed to a consensus and fail to participate at all. This 
difficulty may be reflected in item content as well; if ex- 
perts representing the main currents <Jf thought in a disci- 
pline develop* items pn the initial quettionnatfc» the error 
may be con^pounded. 

One might quesl-ion the logic, for example, of the SWEP sur- 
vey's selecting group members fronj^^'the ranks of reputed 
^forward thinkers**^in education, birsiness arfd iQflustry and 
• government/' Members were chosen Who were considered. 
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' "by their own to be several cuts abcfve the ordinary." While 
SWEP designers maintaine4 that random selection was impos- ^ 
siblc, it is safe to say thai such a group will pi^ifec'predic- \ 
table results. Perhaps this is the greatest single chaise leveled 
against the Delphi: 'by in^biting exploratory thinking, '.it 
merely reaffirrps an^stablishment poini of view, ^ 

As the future forec^ting tool it was, designed to be, the 
Delphi not given'hi'gh marks. However, as a tool to gather, 
information about values and ways the future can be shaped, 
* Delphi can be extremely valuable. Folk offers ^ome final 
advice for those who are considering theij own Ddphi. First, 
you will learn more ^out the procedure by doing it yourself. 
Second, acquaint yourself With alternative versions, especially 
those that deemoha^ize future forecasting. There is np reason, 
for example, why Delphi must be restricted to a mailing tgyr- 
mat. Third, acquaint yoiirseK with the literature so there will 
be no dis^pointment about the outcome. 
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CONCLliSlON 



The school district 'is a peoplcorirttcd enterprise. For 
tifis reason it is important that our h^iWftrtical Mr. Smith , 
amd otfacTS fike him, regardless of their techn^plogicai literacy, 
be ffivoKed in solving the district ''s problems and making/its 
pofiocs. If modem oianagement theory has 2th>thing at alT^to 
siy to school districts, it is that ^ employees ^jsive valuable 
contrflAitioos to make, and they 3xr happier in jo^ wfa^ere 
their opoiions are solicited and respected. The models inchidied . 
here have been selected because offer a non technological 
ahemative to problem-solving an^ because they soliisit and 
respect the opinions of invoived work^o and clients. 

But a m_odel, by its nat^ire, prc?vide^ipnly a g^n^tfral out- 
line or working definition. When it comes rantict with ^ 
real siruation. it can. and should, be .changetrin many vir^ys* 
What we hope to have provided here are only broad outlines 
^ut are not intended to be inclusive or exhaustive of materiab 
on these models. HopefuHy the\* ^provide a simple place to 
begm. / ^ 
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